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FOREWORD 


The  Army  Research  Institute  (ARI)  Is  developing  a  suite  of  six  inter¬ 
connected,  software-based  methods  to  aid  in  the  successful  Integration  of 
soldiers  and  their  equipment.  Software-based  methods  are  only  as  effective 
as  their  design  specifications.  As  part  of  this  effort,  ARI  defined  the 
requirements  for  writing  a  series  of  detailed  design  specifications.  These 
specifications  will  provide  Interface  designs,  equations,  and  data  sources 
and  will  serve  as  blueprints  for  software  and  data  base  development. 

Because  this  project  is  Important,  ARI  developed  alternative  design 
specifications  for  several  of  the  methods.  When  these  alternative  designs 
were  developed,  ARI  selected  those  with  the  most  promise  and  the  lowest  risk. 
However,  the  designs  that  were  not  selected  showed  considerable  merit.  It  is 
our  belief  that  the  designs  not  selected  may  offer  slgnificamt  information  and 
be  useful  in  other  programs.  The  following  report  is  about  one  of  the  design 
specifications  that  was  not  selected.  It  describes  in  detail  how  to  build 
software  to  aid  in  evaluating  a  system  design  by  determining  the  levels  of 
physical,  perceptual,  and  cognitive  characteristics  required  of  operators  and 
maintalners  to  reach  system  design  criterion  performance. 
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DETAILED  DESIGN  SPECIFICATION  FOR  PRODUCT  6:  PERSONNEL  CHARACTERISTICS 
REQUIREMENTS  AID 


EXECUTIVE  SUMMARY 


The  U.S.  Army  Research  Institute  (ARI)  Is  sponsoring  the  development  of 
six  computerized  MANPRINT  decision  aids.  Pour  of  the  aids  will  be  used  to 
establish  weapon  system  performance  requirements  and  the  Army’s  manpower, 
personnel,  and  training  constraints  before  weapons  systems  are  designed.  The 
other  two  decision  aids  will  be  used  to  evaluate  the  manpower  and  personnel 
characteristics  required  by  a  given  system  design. 

The  ARI  program  Is  being  conducted  In  three  phases:  concept  development, 
design  specification,  and  product  development.  This  report  results  from  phase 
2  of  the  program  and  presents  the  design  specifications  for  a  product  ("Prod¬ 
uct  6")  that  will  aid  In  evaluating  a  weapon  system  design  by  helping  the  user 
to  Identify  the  kinds  and  levels  of  personnel  characteristics  required  to  op¬ 
erate  and  maintain  a  given  design  to  specific  performance  criteria.  The  char¬ 
acteristics  and  their  levels  are  provided  for  each  operational  and  maintenance 
Job. 


The  basic  procedure  for  this  product  Is  to  have  the  user  respond  to  a  set 
of  questions  concerning  the  activities  that  humans  will  need  to  perform  In 
order  to  operate  or  zoalntaln  the  system  under  evaluation.  Thus,  It  was  neces¬ 
sary  first  to  establish  a  set  of  human  activities,  with  associated  measures  of 
human  performance,  that  would  encompass  the  actions  that  could  be  expected 
during  the  operation  and  maintenance  of  an  Army  system.  A  determination  was 
made  of  the  human  ability  measures  to  Include  in  the  evaluation  process.  Fi¬ 
nally,  the  ability  characteristics  were  empirically  linked  to  the  performance 
measures  through  statistical  analyses  that  draw  on  ARI’s  Project  A  data  base. 
This  specification  includes  the  algorithms  developed  from  the  statistical 
analysis,  the  software  architecture,  and  the  interface  design. 
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DETAILED  DESIGN  SPECIFICATION  FOR  PRODUCT  6: 
PERSONNEL  CHARACTERISTICS  REQUIREMENTS  AID 

Section  1.0 

Product  Six  Introduction 


1.1  gurpoee 

The  goal  of  Product  Six  ie  to  Allow  its  ueere  to  identify 
the  level  of  personnel  characteristics  nost  appropriate  for  a 
proposed  syetem.  These  characteristics  Bust  be  identified  in 
terns  of  Batching  the  task  denands  of  the  Jobs,  nesting  an 
appropriate  level  of  perfornance  criteria,  and  Baxinizing  total 
syeten  perfornance  effectiveness.  The  key  process  here  is  in 
providing  a  linkage  between  eystea  characteristics  expressed  as 
hunan  operator  and  nalntainer  tasks  (clustered  into  Jobs  if 
Product  Five  is  available),  and  soldier  characteristics 
(attributes  or  abilities  that  can  influence  task  perfornance). 

Product  Six  is  to  provide  a  design  evaluation  aid  that  will 

predict  the  significant  soldier  characteristics  and  levels  of 
*  .  •  • 

those  characteristics  that  are  required  to  operate  and  to 
naintain  to  a  specified  level  of  perfornance  the  hardware  and 
software  fron  a  given  syeten  design.  The  product  Itself  is  not 
neant  to  deternlne  whether  or  not  the  eysten  design  is 
"acceptable,"  but  it  nust  provide  relevant  infornation  that  can 
be  used  in  conjunction  with  the  output  of  Product  Five  to 
deternlne  if  the  proposed  design  Batches  the  Amy's  expected 
hunan  resource  supply  and  linltations. 

_ Product  ■Q.YerT.ieH 

Product  Six  will  output  the  levels  of  the  hunan  ability 
characteristics  required  to  perforn  the  operation  and 
nalntenance  activities  of  Amy  systens.  In  order  to  reach  this 
goal,  it  will  step  the  user  through  a  series  of  slnple  yes-no 
questions  that  will  define  the  activities  that  will  be  perforned 
during  the  syeten  task  or  Job  that  is  being  evaluated.  Once 
these  activities  have  been  defined,  a  set  of  enpirically  derived 
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evaluation  alforithna  will  detersine  the  levels  of  the 
appropriate  human  abilities  required  to  perform  those  activities 
in  a  manner  which  secures  system  performance  goals. 

The  output  from  the  evaluation  process  can  be  displayed  to 
the  user  via  the  computer  screen  or  saved  in  a  system  data  base 
for  further  analysis.  Evaluation  output  can  be  displayed  either 
as  the  abilities  required  to  perform  a  particular  task  or  be 
integrated  to  show  the  requirements  for  successful  performance  at 
the  Job  level. 

l.a., .  Product  Paere 

The  primary  users  of  Product  Six  will  be  Army  military  and 
civilian  personnel  conducting  HAHPBIMT  appraisals  of  new  systems. 
While  such  users  could  be  found  throughout  TBADOC,  AHC,  and  the 
DA  Staff,  the  primary  users  are  likely  to  be  located  at  the  combat 
development  centers.  The  combat  development  centers  now  have 
responsibility  for  preparing  the  target  audience  descriptions 
(TADS)  that  define  the  soldier  supply  constraints  for  new 
systems.  They  are  also  responsible  for  the  determination  of 
whether  a  proposed  system  satisfies  those  constraints.  Table 
1.3.1  lists  the  TBADOC  combat  development  centers,  including  the 
Appropriate  attention  line  for  MAHPBINT  evaluations. 

_ Specification  OYcrYiew 

There  are  two  major  sectioxs  to  this  specification.  Section 
2.0  describes  the  fundamental  approach  and  research  of  the 
product.  This  section  summarizes  how  the  product  was  developed 
and  how  it  will  be  used.  This  information  is  designed  to  serve 
as  a  framework  for  the  more  detailed  screen  and  control 
specifications  presented  in  Section  3.0,  which  contains  the 
actual  design  requirements  to  be  executed  by  the  software 
programmers . 
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Table  1.3.1 

Potential  Aray  Deere  of  Product  Six 


1 

I  ■ 

I 

Aviation  Center 
Ft.  Rucker.  AL  36362 
ATTN:  ATZQ-CDM 


Araor  School 
Ft.  Knox,  KT  40121 
ATTN:  ATSB-CD 

Chaplain  School 

Ft.  Monaouth,  NJ  07703 

ATTN:  ATSC-DCD 

Enffineer  School 
Ft.  Belvoir.  VA  22060 
ATTN :  ATZA-CDli 

Infantry  School 
Ft.  Benning,  GA 
ATTN :  ATSH-CD 

Intelligence  School 
Ft.  Devene,  NA  01433 
ATTN:  ATSI-CDO 

Military  Police  School 
Ft.  McClellan.  AL  36205 
ATTN:  ATZN-MP-CCC 

Ordnance  Hieeile  and 
I  Munitione  School 

^  Bedetone  Areenal,  AL  35897 

1  ATTN:  ATSL-CD 


Air  Pefenee 
Artillery  School 
Ft.  Bliee,  TX  79916 
ATTN:  ATSA-CMD 

Aviation  Logietice  School 
Ft.  Suetie.  VA  23604 
ATTN:  ATSQ-TDN 

Cheaical  School 

Ft.  McClellan,  AL  36205 

ATTN :  ATZN-CM 

Field  Artillery  School 
Ft.  Sill.  OK  73503 
ATTN:  ATSF-CML 

Intelligence  Center 
Ft.  Huachuca,  AZ  31905 
ATTN:  ATSI-CD 

JFK  Special  Warfare  Center 
Ft.  Bragg,  NC.  28307 
ATTN:  ATSO-CD 

Ordnance  Center 
Aberdeen  PG,  MD  21005 
ATTN;  ATSL-CD 

Quarteraaater  School 
Ft.  Lee.  VA  23801 
ATTN:  ATSK-CME 
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Table  1.3.1 

Potential  Army  Oaers  of  Product  Six 
(continued) 


Signal  Schocik 

Ft.  Gordon,  VA  23801 

ATTN:  ATSM-CDM 

Acadeny  of  Health  Sciences 
Ft.  Sam  Houston,  TX  78234 
ATTN:  HSA-CDM 


D.S.  Army  Hedical  Hater ial 
Development  Activity 
Ft.  Detrick,  HD  21701 
ATTN:  SGRD-OMS 


Transportation  School 
Ft.  Eustis,  VA  23604 
ATTN :  ATSP-CDM 

O.S.  Army  Environmental 
Hygiene  Agency 
Aberdeen  P6.  HD  21010 
ATTN;  HSHB-HO-A 

O.S.  Army  Aeromedical 

Research  Lab 

Ft.  Rucker,  AL  36362 


Section  2 . 0 

Product  Six  Systen  Approach 


2.1  Overview 

! 

I 

As  a  s'-Bten  specification,  the  primary  purpose  of  this 
document  is  to  describe  the  Product  Six  process  so  that  it  can  be 
implemented  by  softmare  programmers.  Section  three  of  this 
manuscript  accomplishes  this  goal.  However,  we  believe  that  the 
understanding  of  (and  confidence  in)  how  the  product  will 
function  can  be  enhanced  by  knowledge  as  to  how  it  was  developed. 
Towards  this  goal  this  section  presents  a  very  brief  synopsis  of 
the  development  of  the  evaluation  procedures  contained  in  section 
Three . 

There  were  three  major  aspects  to  the  evolution  of  these 
procedures.  The  first  aspect  of  this  process  was  the 
establishment  of  a  set  of  human  activities,  with  associated 
measures  of  human  performance,  that  would  encompass  the  actions 
that  could  be  expected  during  the  operation  and  maintenance  of  an 
Army  system.  Concurrent  with  this  activity,  the  realms  of 
potential  human  ability  measures  or  characteristics  were  reviewed 
^  to  determine  which  measures  should  be  included  in  the  evaluation 
I  process.  Finally  the  ability  characteristics  were  empirically 
linked  to  the  performance  measures  through  statistical  analyses . 

_ Development  of  Aetlvltv  Measuree 

The  basic  procedure  for  this  product  is  to  have  the  user 
respond  to  a  set  of  questions  concerning  the  activities  that 
humans  will  need  to  perform  in  order  to  operate  or  maintain  the 
system  under  evaluation.  The  procedure,  therefore,  called  for 
the  establishment  of  a  taxonomy  of  human  activities  could 
encompass  the  range  of  actions  that  might  be  required  of  Army 
soldiers.  The  initial  Product  Six  taxonomy  was  formed  by 
merging  and  modifying  two  existing  systems  within  the 
literature.  These  systems  were  McCormick's  (1965)  job  dimensions 
and  the  behavior  taxonomy  developed  by  Berliner,  Angell,  and 
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Shearer  (1964).  The  resulting  classification  system  is  shown  in 
Figure  2.2.1 

In  order  to  obtain  performance  measures  for  the  categories 
in  this  system,  we  turned  to  the  Proiect  A  Longitudinal  Besearch 
Data  Base  or  LRDB.  As  part  of  its  concurrent  validation  effort 
Project  A  administered  over  2,000  hands-on  performance  measures 
(Campbell,  Campbell,  Rumsey,  &  Edwards;  1985)  to  hundreds  of 
soldiers  in  the  D.S.  and  Europe.  These  performance  measures 
corresponded  to  the  steps  involved  in  performing  Army  tasks  and 
were  scored  oh  a  go  versus  no-go  criterion.  All  of  these  steps 
were  sorted  into  the  elementary  categories  of  the  activity 
taxonomy  shown  in  Figure  2.2.1.  A  given  step  could  be  placed  in 
more  than  one  taxonomic  category.  In  this  manner  a  set  of 
performance  measures  could  be  derived  and  calculated  for  each 
activity. 

After  the  initial  sorting  of  performance  measures  into  the 
basic  activity  categories,  some  of  the  categories  had 
insufficient  data  for  reliable  statistical  analysis.  For  this 
reason  some  activities  were  combined  to  form  a  new  activity 
taxonomy  with  sufficient  data  in  each  cell  for  reliable  analysis. 
This  final  taxonomy  is  given  in  Table  2.2,1  and  the  distribution 
of  performance  measures  within  it  is  presented  in  Figure  2.2.2. 

As  can  be  seen  in  the  figure  this  final  combination  of  activity 
categories  led  to  the  sorting  of  sizeable  numbers  of  performance 
measures  within  each  category.  This  distribution  of  performance 
measures  was  assessed  as  satisfactory  to  provide  good  criterion 
reliability  for  the  regression  analyses  to  follow. 

This  system  formed  the  basis  for  the  control  processes  of 
the  product.  The  middle  two  columns  of  Table  2.2.1  document  the 
role  of  the  taxonomy  in  the  product's  evaluation  algorithms.  The 
flow  diagram  index  number  and  evaluation  algorithm  number  mark 


th.  loctlon  .nd  rol.  of  th.t  .ctlvlt,  in  th.  .v.lootion  control 
.l«r«.  (.00  Fifur.  3.2.2).  the  X  ooluon  ^ 

that  nctivlty  «»»  predieted  by  the  ebillty  neaeuree 
final  Btatlatical  analyale. 


T 
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Fl£ure  2.2.1 

Initial  Activities  Taxonony 


Baeic  Categorlee  of  Hunan  Ae-tivltles  f Generic  Tasks) 

Search  for  and  Receiving  Information 

Evaluation  of  Sensory /Visual  Input 
Evaluation  of  Sensory/Visual  Input;  Check 
Viewing  Visual  Input  from  Devices/Eaterials 
e . £ . ,  read  6  digits 

Viewing  Visual  Input  free  Devices/Haterials 
e.g.,  observe  Into  chanber 

Identifying  Obiecte.  Actions.  Events 

5.  Discrlolnates  perceptual  (visual/auditory  input) 

interpretation 

6.  Identifies,  verifies 

7 .  Locates 

8.  Input  froB  Bepresentational  Sources 

e.g. ,  filling  up  forss,  reading  TH  while 
perforBing  engine  Balntenance 

9.  Envlronsental  Awareness 

e.g.,  check  for  leakage/the  presence  of 
T.  CoBplete  on  Tine  Criterion 

e.g.,  read  coordinate  within  1  ainute 


1 .  Detects 

2 .  Inspects 

3 .  Scans 

4 .  ' Surveys 


Information  Processing 

10.  Calculates  Nunerlcal  CoBputation;  Heasure 

11.  IteBlses  Information  Ordering:  Entering  Items 

e.g.>  (announce  elements)  in  order,  record 

12.  Translates.  e.g.,  converts  distance  to  paces 

13.  Interpolates/extrapolate 

13a.  HeBorization  working  memory,  e.g.,  doing  x  before  y 
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Profalftm  solving  ana  Dceielot^  Baking 

14.  Analyze 

15.  CoBparea 

16.  Eetinatea 

17.  Plana 

18.  Judgment  e.g.,  determine  diatanee 

19.  Deductive  Beaaoning 

20 .  Inductive  Beaconing 

21.  Dae  of  Job- related  Knowledge  (from  memory) 

e.g. ,  uae  correct  procedurea  to  (authenticate^ 
aend  meaaage) 

A.  Accuracy  Criterion 

e.g.,  ahould  be ,  ao  that ,  muat  not 
S.  Follow  Taak  Sequence 
M.  Dee  of  Technical  Hanuala 

CniBiPunleatlon  Proeaefiftfi 


22.  Adviaee 


Communicating  Inatructlona/Directione ;  reply 


23.  Directe  Communicating  Inetructione/Dlrectlone 

24.  Bequeeta  or  Queetionlng 

25.  Tranemite  Sending/Beceiving  Heeeagea,  Signal/Code 

communicationa ,  announce 

e.g. ,  announce  elemente  (in  order) 

26.  General  Fereonal  Contact 

27.  Interchange  of  Ideae/Judgmenta  Belated  Information 


Simple /PI aera-fca  Motor  ProeeBCea 


28.  Activatee  Manipulating/Handling  Actlvitlea 

e.g.,  turn  PHB  awitch  on,  releaae  elide  to 


9 


29.  Connects 


30.  Moves 

31.  Sets 


chamber  a  round,  depress  magazine  catch, 
or  trigger 

Manipulating/Handling  Activities;  disconnects; 

Separates;  tie;  Install  assembly 

e.g.f  Join  upper  and  lower  receivers,  connect 

CVC  to  intercom  control  box 

General  body/handling  activities 

e.g..  close  cover,  remove,  pull,  lift,  place 

Manual  Control  Activities 

e.g.,  set  BAKD  switch  to  53>75.  push  safety 
lock  to  safe  position,  pull  the  hood  over 
head  and  down  to  shoulders,  insert,  secure, 
lock,  positioning 


Complex /Can t.lniiQUB  Motor  ProeaBeea 


32.  Adjusts  Adjusting/Operating  Machines/Equipment 

e.g.,  adjust  VOLUME  control  on  intercom 
control  box,  positioning  with  adjustment, 
centering  with  adjustment 

33.  Aligns  Control  Precision,  Control  Equipment  Operation 

34.  Synchronizes  Manual  Control/Coordination  Activities 

manual  manipulation  with  both  hands,  e.g., 
(charge  weapon)  while  holding  trigger  to 
the  rear 

35.  Tracks  Manual  Control/Coordination  Activities,  Control 

Equipment  Operation 

36.  General  Body  Activity  versus  Sedentary  activities 

gross  hand  movements  or  body  activities. 

Sketch;  Mark,  writing 

37.  Use  of  Miscellaneous  Equipment/Devices 

e.g.,  use  1:50000  scale  protractor 
36.  Skilled/Technical  Activities 

precision,  driving  tractor. 
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*  Behavior-oriented  deacriptora  are  baaed  on  or  derived  from  (1) 
overall  aurvey  of  taaka  within  the  Project  A  documentation.  (2) 
McCormick '3  (1985)  job  dimenaion  titlea.  and  the  Berliner  et  al. 
t,axonomy  of  human  activitiea . 
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Table  2.2.1 

Evaluation  /  Criterion  Factore 


Factor  (itll 

Search  for /receive 
inforeation  (A) 

Identify  objects  actions 
and  events  (B) 

Input  frott  representational 
sources  (C) 

Inforaation  processintf  (D) 

Problea  solving  / 
decision  asking  (F) 

I  tJse  of  Job- related 

knowledge  (G) 

Coaaunicatlons  (H) 

Coimect  wires  and 
equipment  (J) 

Boves  (F) 

Sets  controls  (L) 

Adjusts  (M) 

Aligns/synchronises  (H) 

General  body  activity  (P) 

Use  of  technical 
equlpaent  (Q) 
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6120 

9  6 

.37 

6150 

9  11 

.39 

6250 

9  15 

.32 
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Figure  2.2.2 

Final  Diatrlbution  of  Ferfornance  Heasurea 
Across  Activity  Categories 


CHMm)  Catagoi)' 
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The  nunber  of  faunan  ability  seasures  that  could  have  been 
Included  in  Product  Six  la  quite  larce.  For  example,  Fleishsan 
(1975)  identifies  over  forty  variables  that  are  likely  to  effect 
hunan  perforsance.  Luckily  practical  considerations  can  be  used 
to  reduce  substantially  this  nuaber. 

The  priaarily  llaltatlon  to  the  selection  of  variables  to 
include  the  product  is  the  RFP's  £uidance  that  the  ability 
variables  be  those  that  are  now  used  or  are  likely  to  be  used  by 
the  Arny  in  an  operational  node.  This  use  aay  be  as  criteria  for 
enlistment  or  as  projections  of  potential  personnel  supply.  In 
either  case  this  guidance  effectively  Units  the  ability 
variables  to  be  considered  to  those  investigated  by  Project  A. 

It  pas  the  design  goal  of  Project  A  to  detemlne  the  enlistment 
criteria  for  the  Army  of  the  future.  The  project  has  Justly 
received  considerable  acceptance  and  support  from  the  Army,  but 
its  high  cost  renders  any  similar  effort  in  the  future  to  be 
unlikely. 

Project  A  analyses  have  indicated  the  set  of  ability 
variables  that  are  likely  to  be  of  use  to  the  Arny.  These 
ability  measures  pere  designated  for  inclusion  in  Product  Six  and 
are  shovn  in  Table  2.3.1.  In  addition  to  these  ability  measures 
Project  A  identified  a  number  of  background  and  Interest 
variables  that  could  be  valuable  indicators  of  a  soldier’s 
difficulty  in  adjusting  to  the  Army  enviroxuoent .  Hopever.  since 
these  variables  pere  not  predictors  of  technical  performance  they 
mere  not  included  as  part  of  this  product's  evaluation 
algorithms . 


Table  2.3.1 

Husan  Ability  Variablea  Included  in 
Product  Six  Analytic  Development 


Ability.  Canalruct 

Source  of  Data 

Verbal 

ASVAB 

Numerical/Quantitative 

ASVAB 

Technical 

ASVAB 

Speed 

ASVAB 

Spatial 

Project  A 

PeychoBotor 

Project  A 

Aptitude  Area  Composite* 

ASVAB 

Mental  Category  Score* 

ASVAB 

*  Derived  through  the  combination 

Bubtests  and  factors. 

of  the  basic  ASVAB 
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All  of  the  Boldiere  who  oere  adainistered  the  Project  A 
perforaance  aeaauree  outlined  In  Section  2.2  alao  aere 
adalnistered  all  of  the  ability  aeaaurea  contained  in  Table 
2.3.1.  The  relationship  betaeen  the  two  types  of  aeasures  could, 
therefore,  be  deterained  throu£h  statistical  analyses. 

The  first  step  in  this  analysis  computed  simple  correlations 
between  all  possible  combinations  of  performance  activities  and 
ability  variables.  In  order  to  establish  the  stability  of  the 
results,  this  analysis  vas  conducted  on  an  MOS  basis.  This  process 
led  to  a  very  large  correlation  matrix. 

The  oatrix  of  correlations  was  then  reviewed  to  select  a 
set  of  variables  to  include  in  the  aultiple  regression  runs  that 
would  becoae  the  product's  evaluation  algorithns.  The  'set  of 
variables  that  were  selected  for  each  activity  factor  are  given 
in  Table  2.4.1.  The  values  of  r  for  the  aultiple  regressions 
used  to  derive  the  evaluation  algorithas  were  presented  in  the 
last  column  of  Table  2.2.1.  The  evaluation  algorithms  themselves 
are  presented  in  Section  3.3. 


Table  2.4.1 


f 

I  - 

I 


.  0 

1 

Ability  vs. 

Criterion 

Matrix 

• 

Ability 

i' 

Criterion 

Construct 

Verbal 

Hunerical 

Technical 

Speed 

Spatial 

Eaycho^ 

ttOtOX. 

1 

1 

1 

1 

Factor  A 

X 

X 

Factor  B 

X 

X 

X 

Factor  C 

X 

X 

X 

Factor.  JD 

X 

X 

X 

■' 

Factor  F 

X 

X 

1 

Factor  XS 

■ 

X 

X 

X 

• 

FactoxJi 

X 

X 

Factor  I 

X 

X 

X 

Factor  .J 

X 

Factor  K 

X 

X 

1 

Factor  L 

X 

X 

X 

1 

1 

Factor  H 

X 

X 

1 

• 

Factor  N 

X 

1 

Factor.P 

X 

X 

X 

f 

t 

Factor-.fl 

X 

X 

X 

X 
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The  vereion  of  Product  Six  that  cane  out  of  this  proceae 
bears  a  surface  reaesblance  to  the  JASS  procedure  previously 
developed  for  API  (BossDeissl,  Tillaan,  Bisg*  &  Best;  1983).  The 
JASS  procedure  also  had  its  users  step  through  a  set  of  questions 
to  achieve  the  deterBlnatlon  of  the  abilities  required  to  operate 
or  aalntain  an  Arsy  systen.  This  siallarity  is  fortuitous,  in 
that  there  was  considerable  Arny  and  industry  Interest  and 
support  for  the  basic  JASS  concept  as  it  was  originally 
presented . 

The  two  techniques,  however,  are  quite  different  from  a 
technical  perspective.  The  questions  contained  in  JASS  asked  its 
user  to  nake  direct  Judgnents  concerning  the  human  abilities 
required  of  an  MOS  or  task.  Becent  research  (isv  Smith  & 
Bossmeissl)  in  press)  has  indicated  that  such  Judgments  can  very 
difficult  for  Army  personnel  to  make.  Product  Six  will  ask  its 
user  the  more  simple  and  direct  question  of  what  will  the  soldier 
do  as  part  of  the  system.  The  abilities  that  are  required  to 
perform  those  actions  can  then  be  determined  based  upon  sound 
statistically  derived  algorithms. 

Another  important  area  where  the  two  procedures  differ  is  in 
the  determination  of  the  level  of  ability  required  for  successful 
performance.  In  JASS.  the  user  of  the  system  made  a  subjective 
Judgement  of  the  level  of  ability  that  was  required.  For  Product 
Six  the  level  of  the  abilities  that  are  required  will  be  output 
directly  through  the  procedure's  evaluation  algorithms.  This 
output  will  be  derived  from  the  soldier/system  performance 
criteria  that  will  come  from  Product  One. 


rroauc^  £>ix  Design  bpeciiications 

a.l  Input  Data  RaQulremente 

The  input  data  requlrementa  for  Product  Six  are  not 
extensive.  The  prinary  input  to  the  process  will  consist  hunan 
operator  and  nalntainer  tasks.  One  source  of  task  information 
will  be  human  factors  analyses  such  as  critical  tasks  analyses  or 
the  Human  Engineering  Design  Approach  Documents  for  operators  and 
maintainers  (HEDAD-0  and  HEDAD-M). 

These  documents  describe  in  considerable  detail  (drawings, 
time  estimates,  and  textual  descriptions)  the  human  tasks  to  be 
performed  in  operating  and  maintaining  the  proposed  system. 

Decent  major  material  RFPs  (etg^  LHX,  T600,  and  AFV)  have  required 
that  the  HEDAD-0  and  HEDAD-H  documentation  be  provided  very  early 
in  the  design  process,  (is.,  before  down-select  or  prototype 
development).  Because  of  the  Importance  now  being  assigned  to 
HANPRINT  concerns,  it  is  now  likely  that  most  weapon  system 
designs  will  have  HEDAD  information  produced  early  in  their 
development  process.  Given  their  high  level  of  detail,  these 
documents  will  be  excellent  sources  of  task  Information  for 
Product  Six. 

The  user  should  have  access  to  system  design  information 
either  through  design  drawings  or  task  analyses  such  as  the 
HEDAD-M  or  HEDAD-0.  Such  information  is  typically  available  at 
the  point  of  time  when  a  design  is  submitted  to  the  government 
for  evaluation. 

In  order  to  indicate  the  required  level  of  performance  for 
the  human  activities  to  be  performed  the  user  also  will  need 
system  performance  requirements  data.  This  information  can  come 
from  either  the  output  of  Product  Three  or  the  Mission  Area 
Analysis  (HAA). 

Product  Five  groupings  of  tasks  into  Jobs  would  also  be  of 
value  to  the  user  for  producing  summary  analyses.  This  data 
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would  pernit  the  evaluation  of  the  abilities  needed  to  perforn 
the  entire  job  rather  than  siaply  task  requirenents . 


3 ■ 2  Flow  Control  Diagrams 

The  interactive  structure  of  Product  Six  can  be  expressed  in 
teras  of  process  control  diagraas.  These  flow  diagraas  show  ell 
of  the  user  interactions  with  the  product's  hardware  and 
software.  Within  these  diagraas  arrows  that  follow  questions  and 
run  horizontally  indicate  a  TES  response  froa  the  user.  Arrows 
that  follow  questions  and  run  vertically  indicate  a  MO  response 
froa  the  user.  Both  the  TES  and  MO  user  responses  will  be 
entered  froa  the  keyboard  by  typing  a  ■*¥"  or  "N"  respectively. 

The  systea  software  will  verify  that  the  users  response  was 
either  a  "Y"  or  ''M“  before  storing  the  response  and  proceeding  to 
the  next  aodule. 

3.2.1  Overall  Proeese  Flow.  Figure  3.2.1  presents  the 
overall  flow  for  the  entire  product.  Each  of  the  large  boxes  on 
the  left  side  of  this  figure  represents  a  aajor  coaponent  or 
aodule  of  the  process.  The  saaller  boxes  towards  the  right  of 
the  screen  represent  either  user  interface  screens,  as  is  the 
case  for  the  boxes  describing  the  definition  of  the  background 
inforaation,  or  sub-aodules ,  as  is  the  case  for  the  reaaining 
boxes . 

The  inforaation  displayed  in  the  boxes  representing  user 
interface  screens  for  the  background  inforaation  definition 
should  be  displayed  precisely  by  the  systea  hardware  and 
software.  Positions  for  the  user  to  enter  the  appropriate 
background  inforaation  should  also  be  provided  on  the  screens. 

3.2.2  Evaluation  System  Process  Flow.  The  aajor  portion  of 
Product  6  is  its  evaluation  systea.  Figure  3.2.2  details  the 
control  flow  for  this  evaluation  systea.  Each  large  box  in  this 


20 


Figure  3.2.1 

Overall  Product  Flow  Structure 
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Figure  9.2.2 

Evaluation  Systen  Flou  Control 
and  Syaten/Uaer  Interface  Screens 
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figure  represents  a  user  interface  screen  that  asks  the  user  for 
Inforaation.  This  inforaation  is  used  to  identify  which  of  the 
product's  evaluation  algorithas  are  relevant  for  the  systea  under 
review . 

The  text  of  these  user  Interface  screens  (the  large  boxes) 
should  be  reproduced  exactly  by  the  systeas  hardware  and 
software.  The  text  of  the  questions  will  fit  on  a  single 
standard  size  screen.  Users  will  indicate  their  yes  or  no 
responses  to  the  questions  through  the  keyboard  and  the  systea 
will  verify  that  these  response  was  within  the  proper  range. 

The  saaller  boxes  towards  the  right  of  Figure  3.2.2 
represent  calls  to  the  products  evaluation  algorithas.  The 
functioning  of  the  evaluation  algorithas  will  be  discussed  in 
Section  3.3.2. 


Once  a  husan  activity  has  been  identified  aa  being  pertinent 
for  the  aysten  undergoing  review  the  product  Buat  deteraine  the 
levela  of  the  appropriate  hunan  abilitiea  that  will  be  required 
to  perfom  that  activity  succeaafully.  The  product  will 
acconpliah  thia  function  through  a  rating  scale  to  input  the 
perfomance  requirenents  and  a  set  of  linear  algorithna  to 
convert  thia  infomation  into  ability  requirenenta .  The 
resulting  data  and  the  necessary  background  data  will  then  be 
stored  for  further  analysis. 

3.3.1  P»>rfQrii>iir>oe  Rating  Seale.  The  level  of  a  hunan 
ability  required  of  the  personnel  within  a  systen  will  depend 
upon  the  accuracy  requirenents  of  the  activities  they  nust 
perforn.  Figure  3.3.1  shows  the  rating  scale  that  will  be  used 
to  input  this  infomation  into  Product  Six.  This  rating  scale 
is  a  product  user  interface  screen  and  will  be  produced  by  the 
product's  hardware  and  software  exactly  as  shown  in  the  fl^re. 
The  sane  rating  scale  will  be  used  be  used  by  each  of  the 
product's  evaluation  algorithms. 

The  user  will  use  the  systen  effectiveness  information 
provided  by  Product  One  as  the  basis  for  his  or  her  perfomance 
rating.  The  user  will  sake  a  rating  by  noving  the  indicator 
arrow  with  the  cursor  control  keys  to  the  desired  point  by  then 
entering  a  return. 


3.3.2  Evaluation  Algorithipg.  After  the  user  has  Bade  a 
rating  that  indicates  the  required  level  of  huaan  perfomance  for 
a  given  activity,  a  linear  algorithm  will  compute  the  levels  of 
the  relevant  human  abilities  required  to  obtain  that  perfomance. 
These  algorithms  are  presented  in  Figures  3.3.2  and  3.3.3.  The 
algorithms  are  numbered  to  correspond  to  the  calls  Bade  to 
evaluation  algorithms  in  the  evaluation  system  flow  control 
diagrams  (Figure  3.2.2).  (Algorithms  16,  17  and  18  that  were 


referred  to  in  Figure  3.2.2  will  be  part  of  the  product's  task- 
job  integration  functions.  These  algorithms  are  therefore  not 
displayed  in  these  figures.) 

The  algorithms  in  Figure  3.3.2  will  be  used  to  determine  the 
basic  human  abilities  that  mill  be  required  of  the  system.  The 
output  of  this  information  (described  in  section  3.3)  mill  be 
useful  in  comparing  projections  of  ability  demand  versus  supply 
(output  from  Product  Three).  Combinations  of  these  abilities 
could  also  be  used  to  estimate  job  entry  requirements  if  the  Army 
chooses  to  expand  its  enlistment  criteria  based  upon  the  results 
of  Project  A. 

As  noted  above,  the  algorithms  mithin  Figure  3.3.2  should 
prove  useful  in  comparing  the  basic  human  ability  requirements  of 
a  system  to  the  projected  supply  of  those  abilities.  The  Army, 
however,  does  not  now  use  such  basic  information  for  the 
selection  or  classification  of  soldiers.  If  Product  Six  is  to  be 
truly  meaningful  to  Army  users,  it  must  address  such  requirements 
as  part  of  the  evaluation  of  a  system.  The  algorithms  presented 
in  Figure  3.3.3  evaluate  the  system's  human  performance 
requirements  in  terms  of  the  variables  now  used  by  the  Army  as 
enlistment  criteria.  The  output  from  these  algorithms  (again 
described  in  section  3.4)  can  be  used  in  much  the  same  manner  as 
those  in  Figure  3.3.2,  but  the  analysis  mill  likely  have  greater 
immediate  impact,  since  they  mill  be  expressed  in  terms  that  the 
Army  now  usee  operationally. 

3.3.3  Data  Storage  ReQutremants .  After  the  ability  levels 
required  of  a  given  activity  have  been  determined,  the  system  will 
need  to  store  the  relevant  information  for  further  analysis.  The 
data  to  be  stored  must  include: 


1. 


2. 


Background  data  as  entered  during  the  background 
Information  definition. 

The  name  of  the  job  and  task  under  evaluation. 


I 


r 


The  block  nusber  (see  evaluation  Byaten  flow 
dlagraBs)  of  the  activity  that  led  to  the  ability 
requirements . 

The  required  level  of  performance  as  entered  by 
the  user  on  the  rating  scale. 

The  level  of  requirement  for  each  of  the  basic 
abilities  and  Army  enlistment  criteria  as  output 
from  the  evaluation  algorithms  in  Figures  3.3.2 
and  3.3.3. 

This  information  mill  be  maintained  in  a  special  file  within 
the  product's  data  base  management  system.  It  will  be  used  in 
the  summary  analysis  and  evaluation  output  (described  in  section 
3.4). 


i 


3. 

4. 

5. 


! 

I 

I 

I 

I 

? 

I 

! 
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Flffure  3.3.1 

Activity  Perfornance  Rating  Scale 


Rate  the  average  accuracy  required  of  the 
Boldiere  performing  this  activity  that  ia 
needed  to  achieve  miaaion  performance  goala 


1 

1 

100% 

1 

1 

80% 

Uae  the  up  = 

or  down  arrow 

1 

1 

keya  to  move 

1“ 

60% 

the  indicator. 

1 

and  the  return 

1 

1 

key  to  enter  a 

1- 

40% 

reaponae . 

1 

1 

1 

I 

20% 

Activity  Evaluation  Screen  To  be  Preaented 
Before  Each  Evaluation  Algorithm  in  order  to 
Indicate  the  Required  Level  of  Performance 
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Flffure  3.3.2 

Evaluation  AlsorlthuB  for 
Basie  Hunan  Ability  Predictors  of  Perfomance 


Algorithm  Baeie  Ability  Predictor ^Equation 

Munber 


1  AccuracyX 

2  AccuracyX 

3  AccuracyX 

4  AccuracyX 

5  AccuracyX 

6  AccuracyX 

7  AccuracyX 

8  AccuracyX 
8  AccuracyX 

10  AccuracyX 

11  AccuracyX 

12  AccuracyX 

13  AccuracyX 

14  AccuracyX 

15  AccuracyX 


.  26t . 0007 ( Spatial )t . 006 ( Psychonotor ) 
.21(-l)+.002(NuB.)4.002(Tech.)+.007(Spatial) 

.  194. 001 (Mum. )4. 001 (Speed) 4. 009 (Spatial) 

.  414 . 0002 ( Nuud  .  )4 . 0005 ( Speed )4 . 0002 ( Spatial ) 
.194.001(Nud. )4. 001 (Speed)4. 0006 (Spatial) 

. 044 . 003 ( Nub . ) 4 . 0009 ( Spatial ) 

.  324 . 002 (Verbal )4 . 0008 ( Speed ) 

.204. 006 (Spatial) 

.654.0014(Tech. )4.0004(Spatial)4.0002(Psycho. ) 

.  544 . 001 (Technical) 

.004.002(NuB.)4.002(Speed)4.001(Spatial) 

.  324 . 002 ( Verbal )4 . 0004 ( Spatial ) 

.  324 . 002 (Verbal )4 . 0004 ( Spatial ) 

.694. 0013 (Tech. )4.0003(PsychoBOtor) 

.694.023(Nub. )-.05(Tech. )4.031(Speed)4.001(Spa. ) 
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Figure  3.3.3 

Evaluation  Algorlthna  for 
Current  Army  Enlleteent  Criteria 


A 1  +.>iin 

ASVAB 

A  A  Cnnnoitite 

ASYAB  Mental 

Munber 

Score 

Ca-fcftgorv  Score 

AccuracyX  s 

AccuracyX  = 

1 

.00 

4 

.0052(AA) 

.56 

4  .0019(AFQT) 

2 

.12 

+ 

.0049(AA) 

.49 

4  ,0026(AFQT) 

3 

.45 

+ 

.0022(AA) 

.59 

4  .0016(AFQT) 

4 

.54 

+ 

.0018(AA) 

.68 

4  .0008(AFQT) 

5 

.48 

4 

.0018(AA) 

.59 

4  .0013(AFQT) 

6 

.14 

4 

.0042(AA) 

.44 

4  .0026(AFQT) 

7 

.17 

4 

.0040(AA) 

.45 

4  .0024(AFQT) 

6 

.20 

4 

.0027(AA) 

.41 

4  .0015(AFQT) 

91 

.80 

4 

.0003(AA} 

.82 

4  .0002(AFQT) 

10 

.64 

4 

.0015(AA) 

.76 

4  .0007(AFQT) 

11 

.35 

4 

.0025(AA) 

.52 

4  .0017(AFQT) 

12 

.43 

4 

.0029(AA) 

.65 

4  .0017(AFQT) 

13 

.43 

4 

.0029(AA) 

.65 

4  .0017(AFQT) 

14 

.38 

4 

.0029(AA) 

.60 

4  .0017(AFQT) 

15 

.54 

4 

.0014(AA) 

.61 

4  .0013)AFQT) 

1 .  This  evaluation  algorithn  is  baaed  upon  a  regression 
line  that  was  not  found  to  be  statistically  significant  under 
these  analysis  conditions. 
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3 . 4  Output  SerftenB 

When  the  procese  described  In  Flffure  3.2.2  is  cosplete,  the 
user  will  be  asked  if  he  uishes  to  review  the  results  of  the 
process.  Two  levels  of  results  will  be  available:  tasks  or  Jobs. 
The  user  will  be  able  to  select  froB  a  systea  prompt  the  level  of 
analysis  that  he  or  she  wishes  to  review. 

3.4.1  TagV  Evaluation  Output  Seraens.  If  the  user  wishes 
to  review  the  analysis  for  a  particular  task,  the  system  will  ask 
for  the  appropriate  system  and  task  name  or  id.  The  product  will 
then  produce  the  display  the  relevant  information  for  the  task  of 
concern . 

Fiffure  3.4.1  shows  the  output  screens  for  a  task  evaluation . 
The  product's  hardware  and  software  will  produce  these  interface 
screens  in  the  precise  format  shown  in  the  figure.  The  specific 
data  (im.,  the  percentiles)  will  be  obtained  through  table  lookups 
based  upon  the  results  of  the  evaluation  algorithms  (Figures 
3.3.2  and  3.3.3).  In  addition  to  presenting  the  evaluation 
information  on  the  computer  screen,  a  system  prompt  will  ask  the 
user  if  a  hard*copy  printout  is  desired. 

3.4.2  Job  Evaluation  Output  Screens.  If  a  user  wishes  to 
summarize  the  analysis  at  the  Job  or  MOS  level,  the  product  will 
query  for  the  appropriate  system  and  Job  name.  The  product  will 
then  exhibit  the  relevant  ability  information  summarized  for  the 
Job  of  interest. 

Figure  3.4.2  presents  the  user  interface  screens  for  this 
Job  summary  information.  The  specific  data  (ijs,,  ability 
distributions)  will  be  obtained  through  system  summary  analysis 
of  the  results  of  the  evaluation  algorithms  (Figures  3.3.2  and 
3.3.3)  maintained  in  the  product's  data  base.  The  format  of  the 
screens  will  be  as  shown  in  the  figure.  As  was  the  case  with  the 
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task  evaluation  outputs,  the  systes  Hill  also  present  the  user 
with  an  option  for  hard-copy  output. 


3.4.^  Data, :BaBC  Storage  of  Evaluation  Reeulte.  Whenever  a 
task  or  Job  evaluation  is  requested  by  a  user,  the  results  of 
that  evaluation  Hill  be  stored  In  a  product  data  base  file,  as 
Hell  as  being  sent  to  the  screen  or  printer.  If  these  results 
are  requested  again  they  can  then  be  called  from  the  data  base 
rather  than  being  recalculated.  This  data  Hill  also  provide  an 
audit  trail  of  the  evaluation  process  for  any  systea  reviews 
that  are  required. 

Separate  suamary  files  will  be  aalntained  for  task  and  Job 
evaluations.  Output  results  will  be  identified  using  the  systea 
and  Job-task  naaes  as  key  fields.  All  of  the  evaluation  data 
displayed  on  the  output  screens  (Figure  3.4.1  and  Figure  3.4.2) 
will  be  included  in  the  data  base  files. 


Flffure  8.4.1 

Task  Evaluation  Output  Screana 


Systen  Hane 
Task  Hame 


(Percentilo) 
(Percentile) 
(Percentile) 
(Percentile  > 
(Percentile) 
(Percentile) 


Saaple 

Task  Evaluation  Output 
Screes  HuBler  1 

Baelc  Huoan  Ability  Inforaatlon 


Syeten  Nane  _ 

Task  Marne  _ 

Army  Enlletment  Crl-fcerla  Informatien 

ASVAB  AA  CoBposlte  Score  Best  Predicting  Perfornance 


Confidence  Interval  (90%)  Around  AA  Conposlte  Score 


Sample 

Task  Evaluation  Output 
Screen  Munber  2 

Amy  Enlistment  Criteria  Information 
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Fiffure  3.4.2 

Job  Evaluation  Output  Screens 


Syateo  Name 
Task  Naoe 


Raete  Human  Ability  Raoulrangnta 


Verbal  Ability  Bequirement 
Nunerical  Ability  Requireoent 
Technical  Ability  Requlrenent 
Froceaslng  Speed  Requirement 
Spatial  Ability  Requirement 
Fsychomotor  Ability  Requirement 


(Fercentile) 

(Percentile) 

(Percentile) 

(Percentile) 

(Percentile) 

(Percentile) 


Sample 

Task  Evaluation  Output 
Screen  Number  1 

Basic  Human  Ability  Information 
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System  Name  _ 

Task  Name  _ • 

Army  Enlistment  Criteria  Information 

ASVA6  AA  Composite  Score  Best  Predictinf  Performemce 


Confidence  Interval  (90X)  Around  AA  Composite  Score 


Sample 

Task  Evaluation  Output 
Screen  Number  2 

Army  Enlistment  Criteria  Information 
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BeooBJDended  ASVA6  AA  Conposlte  Cutoff  Score 


Becosnended  ASVAB  Mental  Category  Distribution 


*  * 
a  a  a 

a  a  a 

a  a  a  a 

a  a  a  a  a 


I  H  IIIA  IIIB  IV 


X  in 
Job 


Sanple 

Job  Evaluation  Output 
Screen  Musber  1 

Amy  Enlistnent  Criteria  Information 


r 

1 


I. 

I- 


i 


Systen  Hane 
Job  Hane 


Baaie  Human  Ability  Dlgtributiona 


Verbal  Ability  Bequirenent 


Proportion 

of 

the  Job 
Bequlrlns  a 
Given  Ability 
Level 


20  40  60  80  100 

Ability  Distribution  Percentile 


Sanple 

Job  Evaluation  Output 
Screen  Nuaber  2 

Basic  Husan  Ability  Infornatlon 


i 

I 


J 

I 

1 


40 


Syeten  Name 
Job  Hase 


Basic  Hmnan  Ability  Dlatrlbutlona 


Hunerical  Ability  Requlrenent 


Proportion 

of 

the  Job 
Bequlring  a 
Given  Ability 
Level 


20  40  60  80  100 

Ability  Distribution  Percentile 


Sample 

Job  Evaluation  Output 
Screen  Number  3 

Basic  Human  Ability  Information 
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T 


System  Hame 
Job  Name 


Basic  Human  Ability  Dlstrlbutiong 


Technical  Ability  Requirement 


Proportion 

of 

the  Job 
Requiring  a 
Given  Ability 
Level 


20  40  60  80  100 

Ability  Distribution  Percentile 


Sample 

Job  Evaluation  Output 
Screen  Number  4 

Basic  Human  Ability  Information 


1 
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System  Name 
Job  Name 


Basle  Human  Ability  Distributions 


Process ins  Speed  Requirement 


Proportion 

of 

the  Job 
Requiring  a 
Given  Ability 
Level 


20  40  60  60  100 

Ability  Distribution  Percentile 


Sample 

Job  Evaluation  Output 
Screen  Number  5 

Basic  Human  Ability  Information 
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SysteB  Name 
Job  Hane 


Basic -Huaaa .Ability -Ciatribut Iona 


Spatial  Ability  Bequlrenant 


Proportion 

of 

the  Job 
Requiring  a 
Given  Ability 
Level 


20  40  60  80  100 

I  !  Ability  Dietrlbutlon  Percentile 

I  - - - - 


Sanple 

Job  Evaluation  Output 
Screen  Hunber  6 

Basic  Human  Ability  Information 
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System  Hame 
Job  Hame 


1 


Basie  Human  Ability  Distributions 


Psychomotor  Ability  Bequirement 


Proportion 

of 

the  Job 
Requiring  a 
Given  Ability 
Level 


20  40  60  80  100 

Ability  Distribution  Percentile 


'  Sample 

Job  Evaluation  Output 
Screen  Humber  7 

I  Basic  Human  Ability  Information 

1 

1 

1 

f 

i 

\ 

i 
k 


45 


Section  4.0: 
Beferencee 


Berliner,  C. ,  Angell,  D.  and  Shearer,  J.  W.  (1964) 

Behaviors,  aeasures  and  Instrusents  for  perforsance 
evaluation  in  slnulated  environment.  Prr>r»«>^riir>ge .  Symposlun 
and  Workshop  on  the  Quantification  of  Human  Performance, 
Albuquerque ,  HH . 

Campbell,  C.  H.,  Campbell,  B.  C.,  Bumsey,  M.  B.,  and  Edwards,  D. 
(1985)  Development  and  Field  Test  of  Tank -Based  MOS- 
Speelfle  Criterion  Measures;  Volume  7  -  Appendixes  T  -  D. 

U.  S.  Army  Besearch  Institute  for  the  Behavioral  and  Social 
Sciences,  ABI  Besearch  Mote. 

Fleishman,  E.  A.  (1972)  On  the  relation  between  abilities, 

learning  and  human  performance.  American  Psychologist.  M., 
821-834. 

Fc^smeissl,  P.  6.,  Tillman,  B.  W. ,  Bigg,  K.  E. ,  and  Best,  P.  B. 
(1983)  Job  Assessment  Software  fJASS)  for  the  Analysis  of 
Weapons. ^sterns  Personnel  Beouirements :  Technical  Beport. 

D.  S.  Army  Besearch  Institute  for  the  Behavioral  and  Social 
Sciences,  API  Besearch  Beport  A1355. 

Smith,  E.  P.  and  Bossmelssl,  P.  G.  (in  press)  Attribute 

AegCfiBnent ; _ Initial  Test  of  Scales  for  Determining  the 

Human  Becuiremente  of  Military  Jobs.  D.  S.  Army  Besearch 
Institute  for  the  Behavioral  and  Social  Sciences,  ABI 
Technical  Beport. 


A7 


